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FR2-0: Halting Problem 


e Halting Machine takes as input an encoding of a Turing Machine e( M) and an encoding of an input string e(w), 
and returns “yes” if M halts on w, and “no” if M does not halt on w. 


e Like writing a Java program that parses a Java function, and determines if that function halts on a specific input 
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FR2-1: Halting Problem 


e Halting Machine takes as input an encoding of a Turing Machine e( M) and an encoding of an input string e(w), 
and returns “yes” if M halts on w, and “no” if M does not halt on w. 


e Like writing a Java program that parses a Java function, and determines if that function halts on a specific input 


e How might the Java version work? 


e Check for loops 
e while (<test>) <body> 


Use program verification techniques to see if test can ever be false, etc. 


FR2-2: Halting Problem 


e The Halting Problem is Undecidable 


e There exists no Turing Machine that decides it 


e There is no Turing Machine that halts on all inputs, and always says “yes” if M halts on w, and always 
says “no” if M does not halt on w 


e Prove Halting Problem is Undecidable by Contradiction: 


FR2-3: Halting Problem 


e Prove Halting Problem is Undecidable by Contradiction: 


e Assume that there is some Turing Machine that solves the halting problem. 
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e We can use this machine to create a new machine Q: 
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FR2-4: Halting Problem 
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FR2-5: Halting Problem 


e Machine Q takes as input a Turing Machine M, and either halts, or runs forever. 
e What happens if we run Q on e(Q)? 


e If Myarr says Q should run forever on e(Q), Q halts 
e If Vyar says Q should halt on e(Q), Q runs forever 


e Q must not exist — but Q is easy to build if My 4,7 exists, so My arr must not exist 
FR2-6: Halting Problem (Java) 


e Quick sideline: Prove that there can be no Java program that takes as input two strings, one containig source 
code for a Java program, and one containing an input, and determines if that program will halt when run on the 
given input. 


boolean Halts(String SourceCode, String Input); 
FR2-7: Halting Problem (Java) 
boolean Halts(String SourceCode, String Input); 
void Contrarian(String SourceCode) { 
if (Halts (SourceCode, SourceCode) ) 
while (true); 


else 
return; 


FR2-8: Halting Problem (Java) 
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boolean Halts(String SourceCode, String Input); 


void Contrarian(String SourceCode) { 
if (Halts (SourceCode, SourceCode) ) 
while (true); 
else 
return; 


} 
Contrarian("void Contrarian(String SourceCode { \ 
if (Halts (SourceCode, SourceCode)) \ 


po"); 


What happens? 
FR2-9: Undecidable 


e Once we have one undecidable problem, it is (easier) to find more 


e Use a reduction 
FR2-10: Reduction 


e Reduce Problem A to Problem B 


e Convert instance of Problem A to an instance of Problem B 


e Problem A: Power — x” 
e Problem B: Multiplication — x * y 


e If we can solve Problem B, we can solve Problem A 


e If we can multiply two numbers, we can calculate the power x” 
FR2-11: Reduction 


e If we can reduce Problem A to Problem B, and 
e Problem A is undecidable, then: 
e Problem B must also be undecidable 


e Because, if we could solve B, we could solve A 
FR2-12: Reduction 


e To prove a problem B is undecidable: 


e Start with a an instance of a known undecidable problem (like the Halting Problem) 


e Create an instance of Problem B, such that the answer to the instance of Problem B gives the answer to the 
undecidable problem 


e If we could solve Problem B, we could solve the halting problem ... 


e ... thus Problem B must be undecidable 
FR2-13: Reduction 


e Professor Shadey has given a reduction from a problem P,,.,, to the Halting Problem 
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e Given any instance of Phew: 


e Create an instance of the halting problem 
e Use the solution to the halting problem to find a solution for Phew 


e What has Professor Shadey shown? 
FR2-14: Reduction 


e Professor Shadey has given a reduction from a problem P,,¢,, to the Halting Problem 


e Given any instance of Phew: 


e Create an instance of the halting problem 
e Use the solution to the halting problem to find a solution for Phew 


e What has Professor Shadey shown? NOTHING! 
FR2-15: More Reductions ... 

e Given two Turing Machines Mı, Mo, is L[Mi] = L[M2]? 
FR2-16: More Reductions ... 

e Given two Turing Machines Mı, Mo, is L[Mi] = L[M2]? 


e Start with an instance M, w of the halting problem 
e Create Mı, which accepts everything 


e Create M2, which ignores its input, and runs M, w through the Universal Turing Machine. Accept if M 
halts on w. 


e If M halts on w, then L[M2] = &*, and L|M:] = L[My] 
e If M does not halt on w, then L[M2] = {}, and L[M:] 4 L[My] 


FR2-17: More Reductions ... 


e Given two Turing Machines Mı, Mo, is L[Mi] = L[M2]? 
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FR2-18: More Reductions ... 


e If we had a machine Msame that took as input the encoding of two machines M, and Mo, and determined if 
L[M,] = L[M2], we could solve the halting problem for any pair M, w: 
e Create a Machine that accepts everything (easy!). Encode this machine. 


e Create a Machine that first erases its input, then writes e(M),e(w) on input, then runs Universal TM. 
Encode this machine 
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e Feed encoded machines into Msame. If Msame says “yes”, then M halts on w, otherwise M does not halt 
on w 


FR2-19: Rice’s Theorem 


e Determining if the language accepted by a Turing machine has any non-trivial property is undecidable 
e “Non-Trivial” property means: 


e At least one recursively enumerable language has the property 


e Not all recursively enumerable languages have the property 


e Example: Is the language accepted by a Turing Machine M regular? 
FR2-20: Rice’s Theorem 
e Problem: Is the language defined by the Turing Machine M recursively enumerable? 
e Is this problem decidable? 
FR2-21: Rice’s Theorem 


e Problem: Is the language defined by the Turing Machine M recursively enumerable? 
e Is this problem decidable? YES! 
e All recursively enumerable languages are recursively enumerable. 


e The question is “trivial” 
FR2-22: Rice’s Theorem 


e Problem: Does the Turing Machine M accept the string w in k computational steps? 


e Is this problem decidable? 
FR2-23: Rice’s Theorem 


e Problem: Does the Turing Machine M accept the string w in k computational steps? 


e Is this problem decidable? YES! 


e Problem is not language related — we’re not asking a question about the language that is accepted, but 
about the language that is accepted within a certain number of steps 


FR2-24: Rice’s Theorem — Proof 


e We will prove Rice’s theorem by showing that, for any non-trivial property P, we can reduce the halting problem 
to the problem of determining if the language accepted by a Turing Machine has Property P. 


e Given any Machine M, string w, and non-trivial property P, we will create a new machine M’, such that either 


e L|M'] has property P if and only if M halts on w 
e L|M'] has property P if and only if M does not halt on w 


FR2-25: Rice’s Theorem — Proof 
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e Let P be some non-trivial property of a language. 
e Two cases: 


e The empty language {} has the property 
e The empty language {} does not have the property 


FR2-26: Rice’s Theorem — Proof 


e Properties that the empty language has: 


e Regular Languages 
e Languages that do not contain the string “aab” 


e Languages that are finite 
e Properties that the empty language does not have: 


e Languages containing the string “aab” 
e Languages containing at least one string 


e Languages that are infinite 
FR2-27: Rice’s Theorem — Proof 


e Let M be any Turing Machine, w be any input string, and P be any non-trivial property of a language, such that 
{} has property P. 


e Let Lyp be some recursively enumerable language that does not have the property P, and let My p be a Turing 
Machine such that L[Myp] = LNP 


e We will create a machine M” such that W” has property P if and only if M does not halt on w. 
FR2-28: Rice’s Theorem — Proof 
e M': 
e Save input 
e Erase input, simulate running M on w 


e Restore input 


e Simulates running My pP on input 
FR2-29: Rice’s Theorem — Proof 
e M': 
e Save input 
e Frase input, simulate running M on w 


e Restore input 


e Simulates running M yp on input 
e If M halts on w, L[M’] = Lyp, and L[M’] does not have property P 


e If M does not halt on w, L|M"] = {}, and L[M’] does have property P 
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FR2-30: Rice’s Theorem — Proof 


e Let M be any Turing Machine, w be any input string, and P be any non-trivial property of a language, such that 
{} does not have property P. 


e Let Lyp be some recursively enumerable language that does have the property P, and let Mp be a Turing 
Machine such that L[Mp] = Lp 


e We will create a machine M” such that W” has property P if and only if M does halt on w. 
FR2-31: Rice’s Theorem — Proof 
e M’: 
e Save input 
e Erase input, simulate running M on w 


e Restore input 


e Simulates running Mp on input 
FR2-32: Rice’s Theorem — Proof 
e M': 
e Save input 
e Erase input, simulate running M on w 


e Restore input 


e Simulates running Mp on input 
e If M halts on w, L[M’] = Lp, and L[M’] does have property P 
e If M does not halt on w, L[M’] = {}, and L[M’] does not have property P 


FR2-33: Language Class P 


e A language L is polynomially decidable if there exists a polynomially bound Turing machine that decides it. 
e A Turing Machine M is polynomially bound if: 


e There exists some polynomial function p(n) 


e For any input string w, M always halts within p(|w|) steps 


e The set of languages that are polynomially decidable is P 
FR2-34: Language Class NP 


e A language L is non-deterministically polynomially decidable if there exists a polynomially bound non-deterministic 
Turing machine that decides it. 


e A Non-Deterministic Turing Machine M is polynomially bound if: 


e There exists some polynomial function p(n) 


e For any input string w, M always halts within p(|w|) steps, for all computational paths 


e The set of languages that are non-deterministically polynomially decidable is NP 
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FR2-35: Language Class NP 


e If a Language L is in NP: 


e There exists a non-deterministic Turing machine M 
e M halts within p(|w]) steps for all inputs w, in all computational paths 


e If w € L, then there is at least one computational path for w that accepts (and potentially several that 
reject) 


e Ifw ¢ L, then all computational paths for w reject 


FR2-36: NP vs P 


e A problem is in P if we can generate a solution quickly (that is, in polynomial time 
e A problem is in NP if we can check to see if a potential solution is correct quickly 


e Non-deterministically create (guess) a potential solution 


e Check to see that the solution is correct 


FR2-37: NP vs P 


e All problems in P are also in NP 
e Thatis,P C NP 


e If you can generate correct solutions, you can check if a guessed solution is correct 


FR2-38: Reduction Redux 


e Given a problem instance P, if we can 


e Create an instance of a different problem P’, in polynomial time, such that the solution to P’ is the same 
as the solution to P 


e Solve the instance P’ in polynomial time 


e Then we can solve P in polynomial time 
FR2-39: NP-Complete 


e A language L is NP-Complete if: 
e LisinNP 


e If we could decide L in polynomial time, then all NP languages could be decided in polynomial time 


e That is, we could reduce any NP problem to L in polynomial time 
FR2-40: NP-Complete 


e How do you show a problem is NP-Complete? 


e Given any polynomially-bound non-deterministic Turing machine M and string w: 


e Create an instance of the problem that has a solution if and only if M accepts w 


FR2-41: NP-Complete 
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e First NP-Complete Problem: Satisfiability (SAT) 


e Given any (possibly non-deterministic) Turing Machine M, string w, and polynomial bound p(n) 


e Create a boolean formula f, such that f is satisfiable if and only of M accepts w 
FR2-42: More NP-Complete Problems 


e So, if we could solve Satisfiability in Polynomial Time, we could solve any NP problem in polynomial time 
e Including factoring large numbers ... 
e Satisfiability is NP-Complete 
e There are many NP-Complete problems 
e Prove NP-Completeness using a reduction 
FR2-43: Proving NP-Complete 
e To prove that a problem Prew is NP-Complete 


e Start with an instance of a known NP-Complete problem N P 


e Use this instance of N P to create an instance of Phew, such that the solution of Phew gives us a solution 
to the instance of N P 


e If we could solve Phew in polynomial time, we could solve N P in polynomial time, hence Prew is NP- 
Complete 


FR2-44: Proving NP-Complete 
e What does it mean if I could reduce a new problem to a known NP-Complete problem? 
FR2-45: Proving NP-Complete 
e What does it mean if I could reduce a new problem to a known NP-Complete problem? 
e If I could solve the NP-Complete problem quickly, I could solve the new poblem quickly 
FR2-46: Proving NP-Complete 


e What does it mean if I could reduce a new problem to a known NP-Complete problem? 


e If I could solve the NP-Complete problem quickly, I could solve the new poblem quickly 
e But if I could solve the NP-Complete problem quickly, then I could solve any problem quickly 


FR2-47: Proving NP-Complete 


e What does it mean if I could reduce a new problem to a known NP-Complete problem? 


e If I could solve the NP-Complete problem quickly, I could solve the new poblem quickly 
e But if I could solve the NP-Complete problem quickly, then I could solve any problem quickly 


e Haven’t learned anything 
FR2-48: Proving NP-Complete 


e To prove Prew is NP-Complete: 
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e Need to reduce a know NP-Complete problem to Phew 
e Not the other way around 


e Can be confusion the first (or second) time you see it 
FR2-49: NP-Complete Problems 
e Undirected Hamilton Cycle is NP-Complete 
e How would we show this? 
FR2-50: NP-Complete Problems 
e Undirected Hamilton Cycle is NP-Complete 


e Start with a known NP-Complete problem 
e Reduce the NP-Complete problem to Undirected Hamilton Cycle 


e What would be a good choice, given what we’ve already proven NP-Complete in this class? 


FR2-51: NP-Complete Problems 


e Undirected Hamilton Cycle is NP-Complete 


e Reduction from Directed Hamilton Cycle 
e Given any instance of Directed Hamilton Cycle: 


e Create an insance of Undirected Hamilon Cycle 
e Show that the solution to Undirected Hamilton Cycle gives solution to Directed Hamilton Cycle 


FR2-52: Undir. Ham. Cycle 


FR2-53: Undir. Ham. Cycle 
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